REPORT RESUMES 

ED 016 564 re ooo 210 

LEARNING FROM PROSE MATERIAL. 

BY- FRASE, LAWRENCE T. 

PUB DATE FEB 67 

EDRS PRICE MF-S0.25 HC-S0.40 SP. 

DESCRIPTORS- ^QUESTIONING TECHNIQUES! PRETENTION i PREAOING 
INSTRUCTION, PREADING RESEARCH, RETENTION STUDIES, FACTUAL 
READING, RECALL, FEEDBACK, UNIVERSITY OF MASSACHUSETTS, 

THIS STUDY REPLICATED ROTHKOPF'S 1965 STUDY TO 
INVESTIGATE THE EFFECT OF LENGTH OF READING PASSAGE, POSITION 
OF QUESTIONS, AND KNOWLEDGE OF RESULTS ON THE RETENTION OF 
INFORMATION. TWENTY PARAGRAPHS OF BIOGRAPHICAL MATERIAL WERE 
SELECTED, AND TWO MULTIPLE-CHOICE QUESTIONS REQUIRING RECALL 
OF SPECIFIC FACTUAL INFORMATION WERE CONSTRUCTED FOR EACH 
PARAGRAPH, TOTALLING 20 RETENTION QUESTIONS AND 20 INCIDENTAL 
QUESTIONS. THESE WERE PRESENTED IN CONVENTIONAL PROGRAMED 
FORM FOLLOWING A PARAGRAPH-QUESTION-KNOWLEDGE OF RESULTS 
SEQUENCE WHICH VARIED ACCORDING TO THE EXPERIMENTAL GROUPS 
COMPOSED OF 72 EDUCATIONAL PSYCHOLOGY STUDENTS. SEVEN OTHERS 
SERVED AS THE CONTROL GROUP. RESULTS SUPPORTED ROTHKOPF’S 
FINDINGS THAT QUESTIONS HAVE A GENERAL FACILITATIVE EFFECT ON 
RETENTION AND THAT RETENTION IS IMPROVED WHEN KNOWLEDGE OF 
RESULTS IS PROVIDED. THE LONGER THE PASSAGE, THE BETTER THE 
RETENTION OF INCIDENTAL MATERIALS. HOWEVER, RETENTION 
QUESTIONS WERE MORE EFFECTIVE WITH PASSAGES OF MODERATE 
LENGTH. QUESTIONS, RETENTION OR INCIDENTAL, PLACED BEFORE 
THE PASSAGE REDUCED THE RETENTION OF INFORMATION. THE 
POSITION OF QUESTIONS, HOWEVER, DID NOT MAKE MUCH DIFFERENCE 
IF KNOWLEDGE OF RESULTS WAS PROVIDED. QUESTIONS WERE MOST 
USEFUL AFTER THE PASSAGE, IF KNOWLEDGE OF RESULTS WAS NOT 
PROVIDED. THIS PAPER WAS PRESENTED AT THE AMERICAN 
EDUCATIONAL RESEARCH ASSOCIATION MEETING (NEW YORK, FEBRUARY 
1967) * (NS) 
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This study dealt with the effect of factual questions upon the 
retention of Information from prose material. If questions are to 
toe used as study aids with prose passages, what Is the optimal 
spacing of these questions? Are. questions more useful before the 
passages (as guidance )» or are they more useful after the^passages 
(in a review capacity)? If questions come before the reading 
passage subjects may tend to focus on question-relevant content 
within the passage and hence retention of other material within 
the passage would be relatively low* Such a v i ew ^ \ 0 4 !! £ 
tent with the cybernetic approach of Smith and Smith (19ooj, ^wnicn 
ass ume s that a test question provides a criterion to use during 
reading — a criterion of what is and is not relevant* An altern- 
ative approach » the view of Rothkopf (1965)* stresses the role of 
mathemagenlc or attentive behaviors which are under the control or 
the test questions* 



The present study attempted to replicate the results of a 
study by Rothkopf ( 1965 ). which shewed, briefly, that questions 
have a general facilitatlve effect upon retention and that retention 
of specific questions is improved when knowledge of results is 
available. This study differs from the Rothkopf study in that the 
prose materials were different* only multiple choice questions^ were 
used in the present study, the present materials were about half 
the total length of those used by Rothkopf, and, an additional 
variable was added in this study — length of passage before a 
question was introduced* The hypothesis here was that if prose 
passages are too short the prose structure loses control over 
behavior* If passages are too long — questions lose control over 
behavior* 



To summarize, the present study investigated the interaction 
of length of passage, position of questions, and the availability 
of knowledge of results* The effect of these variables upon the 
immediate retention of information which was relevant or incidental 
to the questions asked during reading was analyzed (I refer you to 
Table 2 for a summary of the design) • 




METHOD 

Twenty 10-line paragraphs of biographical material on Henry, 
Tames were selected from Miller^ introductory text. Two multiple- 
choice questions which required the recall of specific factual 
information (such as a course of study undertaken by James) were 
constructed for each paragraph* The reading material took the form 
of conventional programmed booklets* On one sheet of paper the 
subject found a paragraph of prose material, on the next page a 
question over that material, and on the following page knowledge 
of results was given by repeating the correct alternative along 
with the stem of the question* The sequence of paragraph-question- 
knowledge of results that a subject saw de pended u pon th e experl- 

mental group to which he was assigned* ; u.s. department of health, eoucation a welfare 
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Seventy-two introductory educational psychology students were 
the sublects. The three factors in the design were: 1. questions 

before or after prose passages, 2* length of passages between 
questions *10. 20, or 40 lines long), and 3. knowledge of results 
present or absent following the questions# 

Two dependent measures were obtained immediately 
reading task: 1, the number of correct responses to the 20 questions 

which had been used with the reading passages (called retention 
questions), and 2. the number of correctresponsestothe20 
questions covering material not questioned In the reading task 
(called incidental questions), 

A control group of seven subjects was run to give a baseline 
level of responding by simply reading through the prose material. 



RESULTS 

The results of the present study agree quite well with the 
data of Rothkopf f s study, I refer you to Table 1 which presents 
these data for comparison* There is a significant rank order 
correlation between the two sets of data. 

In regard to retention questions, there was a significant 
main effect for all three factors. Here I refer you again to 
Table 2, It can be seen that presenting questions before tne 
reading of paragraphs had the least facilitating effect .. . 

retention. There was a significant interaction between the position 
of questions and whether or not knowledge of results was available. 
The results suggest that the position of retention que s is 
the prose does not make much difference if knowledge of results is 
provided. If knowledge of results is not provided, then the 
questions are most useful following the reading passage. 

Data on length of passages reveal that the moderate length 
was an optimal level in terms of the retention questions. If 
passages are too long, associations between questions and content 
may be difficult to establish. If passages are too short, necessary 
continuity among prose content is broken. 

In terms of incidental questions, there was a significant 
effect of the position of questions within the prose. Questions 
before the passages tended to reduce retention of information from 
other portions of the material. The largest inhibition of learning 
(i.e., scores lower than the control group) occurred for the 
incidental material when questions were placed before the passages 
(I refer you to Figure 1), In general,, if acquisition of the total 
passage is the objective of instruction,, then questions should 
be placed after the reading passages. 

In contrast to the curvilinear relationship for retention 
questions, there was a gradual improvement in scores on incidental 
questions with the larger passages. This trend implies that whole 
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reading may be an optimal procedure If no precise guldenoe Is to be 
given. Results, Interestingly enough, seem to oonflrm both a small 
step approach (for retention of specific content) and a whole reading 
approach (for retention of general content)* 



SUMMARY 



In summary » the most interesting results were these. First * 
they strongly support the data of Rothkopf. Second; the ® 

passages the better the retention of incidental material. w 8 

not the case for retention of relevant questions* Third; the 
tendency in both this study and the Rothkopf study was for the 
groups which had questions before the prose passages to score below 
the control group mean on incidental questions e f feot. 

Fourth; the most obvious effect was the widespread facilitation of 
retention when the question occurred after the reading Pf ssa £®f * r 5 
could very well be that changing the position of a question changes 
its function. A factual question following a paragraph may act as 
an irrelevant question for the passage which follows it. Hence , the 
question would act as a cue to study all the factual material or 

the next paragraph. 



The results of the present staidy are in accord with both the 
data and the mathemagenic theory postulated by Rothkopf* I have 
given a somewhat more molecular interpretation on the final pages 
of the handout. I have also listed briefly some Implications of the 
operant theory suggested. Basically » the theory postulates that a 
question is a discriminative stimulus for an observing response. 

The reinforcing stimulus for the observing response is any question- 
correlated stimulus within the passage. A specific factual question 
le.g., "When was James born?") may have one associate, if the question 
is of a comparative nature (e.g., "Was William older than Henry? ) 
it should have several associates. I am now collecting norms on a 
small number of questions by asking subjects to underline words in 
prose passages which would comprise an answer to the questions. An 
index of diversity (number of words underlined divided by the total 
number of words in the passage) seems to give some Indication of the 
snecific or general acquisition potential of the questions. The 
questions should be related to the amount of incidental or relevant 
information acquired from prose passages to which they relate. A 
study is now underway in which an attempt is being made to relate 
this index of diversity to differential acquisition. The idea here 
is that if every sentence in a passage is related to the pre-question 
the attentive response is on a continuous schedule of reinforcement. 

If the question relevant sentences are randomized this would be 
analogous to a VR of reinforcement. Changing schedules of rein- 
forcement (prose structure) in this way should have implication for 
the maintenance of attentive behaviors and hence for retention. 
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TABLE 1 




Comparison of Percentages Correct with Data of Rothkopf 
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Retention 
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61 
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Incidental 
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61 



Hote. — LBA = all questions and answers were given,, then Ss read passages 
(in the present study the AO-line length most nearly approaches this con- 
dition)! SB = questions occurred before each paragraph! SBA « questions and 
answers given before each paragraph! SA = questions given after each para- 
graph! SAA = questions and answers given after each paragraph! Control • 

read prose passages*. 

a Data taken from Figure 8 in Rothkopf (1965) 
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Figure 1. Comparison of control group mean with 
means of individual groups of retention and inci- 
dental questions. 



Operant Paradigm of Prose Reading 

aax = specific question S§ = prose associate of S Q1 

cT associate of S nl (as reinforcing event) 
S„, , = comparative question Si = associate oi o Q1 

Qx 9 ^ 



„ observing response % = correct response to S Q1 
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Stage X. Test-taking experience 

q p - s° - R, - S r (praise, passing grade,- etc.) 
b Ql« n o r 1 

With test-taking experience (^a form of concept formation^n 

which S learns to respond appropria elg t P asso- 

arafjrf-sss?“s^:* >.• 

Reading prose with questions 
A specific question before a paragraph 

S Q1 - R 0 " S 1 



Stage II • 

a* 

b* 



A comparative question before a paragraph 
S Q1,2 " R 0 “ Sl 

X sl 

A specific question after a paragraph (followed by relevant 
question) 
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A comparative question after a paragraph (followed by relevant 
question) 
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Implications of the Theory 

1, Distinction between specific and general questions 

A question stem sS has few associates (specific question) or 
many (multiple choice or comparative questions). The generalization 
effects of a question may be defined in terms of the number of 
words or sentences in the prose which Ss indicate are associates 

of S§, 

General questions, with more associates, provide more rein- 
forcement for R n . The effect of general questions may extinguish 
more rapidly than with specific questions since Rq is maintained 
at a higher rate, but for general acquisition these questions 
should be more effective initially . 

An alternative view would be that the reinforcement event is 
really an S$, i.e,, content associated with is a discriminative 
stimulus for R^, The assumption of the present view is that Rq 
is already occurring and that the rate of Rq is selected by S • 
Subjects do not gaze blankly at prose until, by chance, they are 
somehow stimulated by an S • They do attend while reading, the 
problem is why they emit more attentive responses at particular 
points. Placing the weight of explanation on the reinforcement 
mechanism (rather that S ) implies that generalization of 
effects of the question occurs at the point of contact with the 
associated stimulus material, not before, and that this general- 
ization is defined in terms of Rq, In the final analysis, of 
course, Rq is defined in terms of. test scores. 
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3, Distijfc.?ic.ti<>h:.v between questions before and after paragraphs 

With a general question before a paragraph R Q is reinforced 
more often by virtue of its larger number of associates, hence 
general questions should be more facilitating than specific 
questions before prose passages. 



A specific question and a general question after a paragraph 
act as irrelevant questions preceding the next paragraph. The 
number of associates of a specific question should be high under 
these conditions (any fact), perhaps too high. The associates of 
the general question should be roughly equivalent. Rq should 
extinguish more rapidly when S q comes after passages because it is 
emitted at a high rate, yet when the relevant question does occur 
only a few responses are reinforced. The implication is that 
questions after passages are initially facilitating, but because 
R n extinguishes more rapidly with long reading passages, extinction 
of the previously learned test-taking or mathemagenic behaviors 
occurs. The present paradigm implies an interaction between 
question position and question type, 

A basic assumption here is that a stimulus is most effective 
when acting in a forward manner. Hence, the effect of "review" 
questions (after passages) may be to facilitate performance on the 
paragraphs following the review, 
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